A generalized triangular form and its global controllability 
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Abstract. 



rj . We investigate a new class of nonlinear control systems of O.D.E., which are not feedback 

Q ■ linearizable in general. Our class is a generalization of the well-known feedback linearizable 

^ ' systems, and moreover it is a generalization of the triangular (or pure-feedback) forms 

^ • studied before. The definition of our class is global, and coordinate-free, which is why 
the problem of the equivalence is solved for our class in the whole state space at the very 
beginning. The goal of this paper is to prove the global controllability of our nonlinear 

>• I systems. We propose to treat our class as a new canonical form which is a nonlinear global 

QQ I analog of the Brunovsky canonical form on the one hand, and is a global and coordinate-free 

^ ! generalization of the triangular form on the other hand. 
O 

Q . Key words: Nonlinear control, triangular form, global controllability, feedback lin- 

r-| ■ earization. 
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'ijji • 1. Introduction. 

X 

C^ ' One of the most important problems in the nonlinear control theory is the problem of 

classification of nonlinear control systems of O.D.E., i.e., that of finding the transformation 
of a nonlinear control system into its simplest canonical form along with finding such canon- 
ical forms by using some invariants which do not depend on the choice of local coordinates. 
Beginning with ^2] 5 ^I] 5 a complete theory of feedback linearization was created - j3] , jHSl , 
122]; [Sj; [in|;[n]; [2n]; etc. However, even some simple mechanical systems do not satisfy 
the Respondek-Jakubczyk-Hunt-Su-Meyer conditions; in addition, the concept of feedback 
linearization is essentially local. This inspired many authors to further investigations and 
to attempts to generalize the feedback linearization theory. 

One possible approach, which is is very popular and has various applications, is the 
concept of differential flatness |H]. However, this notion is as local as that of feedback 
linearization, and moreover no general criterion of differential flatness has been obtained. 



Another way is to deal with the triangular, or pure-feedback form instead of the 
Brunovsky canonical form. Triangular systems were introduced in |15j as early as 1973 
(i.e., even before JI^jCI]) ^ ^ ^^^^ example of a nonlinear system which is feedback lin- 
earizable. Nevertheless, a triangular system 

Zi = fiizi,...,Zi+i), i = l,...,n-l; 

is feedback linearizable only in the so-called "regular" case, i.e., when the conditions of 
regularity \ gj' \^0, i=l,...,n hold; otherwise (the "singular case"), the system does not 
satisfy the Respondek-Jakubczyk-Hunt-Su-Meyer conditions, and, therefore, is not feedback 
linearizable. The singular case was investigated by Respondek in 1986 (see j^), and by 
Celikovsky and Nijmeijer in 1996 (see |3]). In these works, the triangular systems are 
studied under the assumption that the set of the regular points is open and dense in the 
whole state space, however. This is not true even for some simple examples (see, for instance 
system (fTIHl from the current paper). 

That is why, we want to find and to investigate a generalization, of the triangular 
form, which contains all the previous triangular forms studied before (including the singular 
case) on the one hand, and which can be investigated globally (including the problems of 
controllability, stabilization, feedback equivalence, etc.) on the other hand. We offered such 
a generalization in [20] , and solved completely the problem of global robust controllability 
for this class (moreover, the controls constructed were actually closed-loop to some extent). 
However, the problem of global equivalence of a control system to a system from pUj 
remained open. In this work, we introduce a generalization of the triangular systems 
considered in [20] , in global coordinate-free terms. The main goal of the current paper is 
to prove that our generalized triangular form is globally controllable. 

In the future, we want to investigate in more detail the relationship between the tri- 
angular form from [20] and the class from the current paper. As we can see from example 
3.1, the class of "generalized triangular form" is wider than that from 120] • On the other 
hand, the construction of example 3.1 is based on triangular system fllO|) . To what extent 
our generalized triangular form can be reduced to the triangular form in the singular case 
remains an open question. 
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discussion about these results. 



2. Notation, and preliminaries. 

Let M be a smooth manifold of dimension n, and x ^^ v{x) be a smooth vector field 
on M. In general, f (■) can be defined on some open subset of M only; next we denote this 
subset by T)^. Let x° be in M. By J9ti-^$* (x*^) we denote the (maximal) integral curve 



t I— i> x(t) of X = v{x) with x(0) = x^. Of course, for each t & I the map x ^-^ ^Hx) is 
(at least) a diffeomorphism of some neighborhood of x° onto some neighborhood of $* (x'') 
(and, if, for some s E I, $^(x) is well-defined for all x E Tiy, then x \—>- $*(x) is a global 
diffeomorphism of D„ onto D„) 

For every fixed t E I, every a; in a neighborhood of x°, and every ^ G TM^; by ($* )^ C, 
we denote the image of ^ under the tangent map of the diffeomorphism y \—>- $*(?/) at point 
X. (Actually, ($*)^^ depends on two arguments ^ and x, and we should write ($*)^ (x,^), 
in general, but in our case it will be always clear at which point x G M we consider the 
tangent map, which is why we write ($*)*^ without any ambiguity.) 

In addition, if V^ is a vector space, then, for A G V, and -B C V, we denote hj A + B 
the set {x + y I x E A, y E B} {in our situation V will be TJVix for some smooth manifold 
M and some x G M). 

If A(-) is a smooth integrable distribution on M, (which means that the dimension 
dim A(x) equals k < n for some fixed k = 1, ..., n, and for all x G M, and A(-) is involutive 
at each point x G M) then, for each x° G M, we can consider its orbit, or the maximal 
integral manifold Ma(x°) defined as the set of all points y G M given by 

y={^l\o^llo...oc^ll)ix') (1) 

with arbitrary A^ > 1, arbitrary ti eH, i = 1, ...,N, and arbitrary smooth vector fields f j(-) 
such that, for every i = 1, ...,N, and every x G Tiy. we have Vi{x) E A(x). Also we will use 
a more brief form of (^ : 

y = $^(xO) withT=(ti,...,t;v), v = {vi,...,vn). (2) 

By $^"^(-) we denote the inverse diffeomorphism, i.e. i^y^^ ° ^v^/li^ o ... o <l>^^*i j (■) 

We write by definition f (■) G A(-) iff v{x) E A(x) for each x G 1)^. Let us recall that, 
if f (■), and w{-) are smooth vector fields defined on some open subset 2) C M, then by 
[t", w](-) we denote their Lie bracket defined (in any coordinates) as [f, w](x) = ^v — ^w. 
Finally, for A C M, we denote by A the closure of A in M. 

3. Main result. 

We consider a control system 

X = a(x) + /3(x, u)6(x) (3) 

with states x G M, and controls u E R\ where M is a simply connected manifold, a(-), 6(-), 
are smooth vector fields (of class C""^^ at least) on M, and /?(■, ■) is a smooth (of class C""^^) 
scalar function on M. Next we suppose that M = R" just to make the arguments clearer, 
however our technique works for arbitrary simply connected manifold M. We assume that 
a(-), 6(-), and /?(■, ■) satisfy the following conditions 

(A) For each x E M,, we have 6(x) 7^ 0, and /3(x,R^) = R^. In other words, the set 
Ao(x) := {/5(x,m)6(x) I u E R^} is a 1- dimensional subspace ofTlVlx=W^ for each x G M. 



(Of course, the distribution x ^-H> Ao(x) is integrable in the whole M, and, for each 
x^gM, the corresponding maximal integral manifold of Ao(-) is the (maximal) trajectory 

t ^ mx°)). 

(B) Let k be in {1, ..., n—1}. Assume that the distribution 7v[3x^-^Ak^i{x) C TM2^=R"' 
is already constructed: for k=l, see condition (A), for k>l, we define Afc(-) by induction 
as below. Then: 

(Bl) We require that x ^-^ Afe_i(a;) is of rank k for every xGM, and is involutive at 
each xGM. 

(B2) Given x°gM, by Afc(x°) denote the set 

Afc(x°):=A,_i(x°) + {(0,a('^-^(a;°))-a(^°)l ViV>l VT=(ti, ..., t^) 

\fv{-) = {vi{-),...,VN{-)) such that fi(x)GAfc_i(x) for all xgD^^, i=l,...,N} (4) 

We require that, for each x^gM, the set Afc(a;°) is a (k+l) - dimensional subspace of 
TM^.o = R" and that the distribution x i-^ Afc(a;) is involutive (for all k = 0, . . . ,n — 1, as 
we mentioned before.) 

We emphasize that, for each fixed x°, we obtain Afc(x°) in (@)) by taking all admissible 
Vi{-) from Afc_i (i.e., along the maximal integral manifold J\Iai,__i{x^) defined in (jT])). 

Let us remark that conditions (A), (Bl), (B2) are global analog of the conditions from 

ca, nn- 

If a smooth system x = f{x,u) is locally feedback equivalent to the triangular form, 
then (see [12]) /(■,■) have (locally) the form Q: f{x,u) = a{x) + P{x,u)b{x) with some 
smooth vector fields a(-), 6(-), b{x) ^ and with some smooth scalar function P{-,-), 
regardless of whether this triangular form satisfies the regularity conditions L •'' I 7^ 0, or 
we deal with the singular case. 

Furthermore, any triangular system 

'- fi{Xl, ■■■,Xi+i), i = 1, ...,n — 1; \T ^ -on ^ ol /p:\ 

_ X= {Xi,...,Xn) GR, MGR (5) 

~ Jn\Xi, ..., Xfiy U)j 

such that fi are smooth, and fi{xi, ...,Xi,R^) = R^, for all i = I, ...,n and all (xi, ...,Xi) G 
R* (see 1201) satisfies our conditions (A),(B1),(B2) 

Conversely, assume that system Q satisfies (A),(B1),(B2). Pick any x^ G M, and let 
( = (p{x) : ?7(x°)cM -^ V"((y5(x°))cR" (Ci = V^j(a^), ^ = 1, ■■■,n) be a diffeomorphism of a 
neighborhood f/(x°) of x^ onto a neighborhood V{ip{x^)) of ip{x^). 

Definition 3.1 We say that coordinates Q are canonical for system H^, or the map 
x^—>-(=ip{x) defines canonical coordinates for system ^ (or canonical coordinates for the 
corresponding sequence of nested regular integrable distributions Ao(-), ..., A„_i(-)j in f/(x°), 
iff, for each k = 0, ...,n— 2, the set ip~^{Dk) with 

-Dfc := {(Ci,---,Cn) G ^(V^(a;°)) I = const, i = I, ...,n-k-l} 

is an integral manifold of Ak in U{x^). 




Equivalently, coordinates yi=ipi{x) i = l,...,n, are canonical for system Q in U{x^) 
with small enough f/(x°), iff 



Ak{x) = {eGTM,=R" I < V<^i(x), e >= 0, 



1, ...,n—k—l}, k = 0,1, . . . ,n — 2. 



Remark 3.1. It is easy to prove that, if coordinates (i=ipi{x) are canonical for Q in 
a neighborhood of some x°gM, then, (locally!) in some neighborhood of x°, this change 
of coordinates (i=!fi{x) brings the dynamics of to the following triangular from 
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/Ci \ 
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Cn-2 
Cn-1 
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\Cn J 


\ 



/l(Cl,C2) \ 

fn-2{Cl, •••,Cn-l) 

/n-l(Cl) ••■)Cn) 

V /n(Cl,-,Cn) / 



+ /3(C,w) 



/ \ 




V ^n(Cl,--,Cn) J 



(6) 



where 5'n(C)7^0 in some neighborhood of ip{x'^) (but, of course the regularity conditions 
IgT^I 7^ do not hold, in general). However, this is true only locally, as we can learn from 
the following example. 

Example 3.1 Consider the vector fields fi(-) and V2{-) in R^ given by Vi{x) = 
(cosa;i, — sina;i) , and V2{x) = (sina;i, cosxi) . Put x% = (vrA^, 0) G R^ for all N E Z. 
For each N E Z, the map given by R^ 3 {zi,Z2) i— > {^l\ o ^l^J(x%) is a diffeomor- 
phism of R^ onto ]7r(A^ — l),7r(A^ + l)[xR (we do not solve the corresponding differe- 
tial equations explicitely just because the solution can not be written out as a combina- 
tion of standard functions). Fix any Zi > 0. Denote by A{zi) G R^ the intersection of 
the trajectory Z2 ^-^ {^11 o $^^)(xg) with {|} x R; then from the symmetry of the curve 
Z2 H-* (<l>j;2 o<|)^i)(xq) w.r.t. {|} x R we obtain that there is a unique solution (^2(2:1), Zi{zi)) 
of i^lf'^ o $^^)(a;0) = $^i(^^)(x?) w.r.t. {^Zi), ^i(^i)); 



^il^i. 



Zl] 



Mzi] 



2(n) 









[X, 



OJi 



(7) 



and there is a unique solution {z2{zi), zl{zi)) of the nonlinear equation f ^ll ^^ o $^1 j (x?) 
<^ll^"'\x^o) w.r.t {z*2{zi),zl{zi)), and 



2^1(2:1) = ^1; z^^zi) 



-zi[zi); 



Aiz,] 



$ 2 



.. oKDi^y, 



r.0\. 



(in addition, the image of the curve H 3 Z2 ^—>- ($^2 ° ^vl){^i) coincides with the image of 
R9^2^($^^o$^i)(a;[])). 

Similarly, for any fixed Zi < 0, there is a unique solution {z2{zi), Zi{zi)) of the equation 
i^tf'^ o $:i)(x[]) = ^t\^''\x'_,) w.r.t. iz2,z^) and 

zi{zi) = zi; Z2{zi) = Z2{-Zi) (9) 

(Of course, for zi < 0, and for the left half-plane, we could write the equalitites which are 
similar to (jH)), but we omit that). 



By definition, we put 




' h{z^) 


if 21 < 


^{zi) = < +00 


if zi = 


^ Uzi) 


if 21 > 


and consider the triangular system 




f. 


= fl{zi,Z2) 


i2- 


= u 



R^]0,+oo[ 



(10) 

witli states (zi, Z2) G R^ and controls m G R^, where fi{zi, Z2) is given by 

{Z2 sin Z2 if 2:2 < 

ifO<22<^(^i) :RHO,+oo[ 

(2:2-^^(2:1))^ sin(2;2-^(zi)) if Z2 > ipizi) 

(if Zi=0, then ■iIj{zi)= + 00, and /i(0, Z2)=0 for all Z2>0, by definition.) By definition, put 
/(^):=| ^'^^^''''M' 9{zy.= (^A, Mz)=iK°K)i^%)^ z={zuZ2)eR', 



and define in ]— 7r,7r[xR C R^ the vector fields A{-), and B{-) hj A = (</)o)*/, B = (</)o)*5'- 
Then the system 

x = A{x) + B{x)u (11) 

is well-defined in ]— 7r,7r[xR, and satisfies conditions (A), (Bl), (B2). Finally, using the 
maps 0i(-)) 4>~i{'): and the above-mentioned symmetry (see (jZj),®,©), we can easily ex- 
tend vector fields A{-) and B{-) onto ]— 27r, +27r[xR, then onto ]— Stt, +37r[xR, and even- 
tually onto R X R so that (A), (Bl), (B2) hold in R^. Of course, system (fTTj) is not globally 
feedback equivalent to a triangular system of form (jHl) in the whole R^ (for instance, because 
it is globally equivalent to (fTIH) in ] — vr, 7r[xR). On the other hand, system (|TT|l satisfies 
conditions (A), (Bl), (B2) in the whole R^ by the construction. 

Our main result is as follows. 

Theorem 3.1 Assume that vector fields a(-), b{-) and function (3 {■ , ■) are of class C"^^, 
and satisfy conditions (A),(B1),(B2). Then system ^^ is globally controllable (in the whole 
My) in any time [to,T]. 

The goal of this paper is to prove theorem 3.1. 

4. The reduction of the main result to a "back-stepping" procedure. 

As we see from example 3.1, system (jHl) is not globally feedback equivalent to a system 
from |2Q,| in general, which is why the technique developed in [ini,[2n] should be at least 
revised essentially. However, if we want to follow this pattern, we must first pick a point 
(x*,u*) G M X R^ around which system Q is regular, and (locally!) feedback linearizable. 
Using conditions (A), and (B), we easily get the existence of a point x* G M such that 

{6(x), [a, 6](x), ..., (adj,~^6) (x)} is a basis of Aj_i(a;) 



for all xe W{x*), i = l,...,n (12) 

for some neighborhood W{x*) of x* in M. 

Pick any ti e]to, T[. In order to prove theorem 3.1, it suffices to show that we can steer 
any initial state x^ into x* in time J := [to,ti], and that we can steer x* into any terminal 
state x"^ in time I := [ti,T] w.r.t.©- Next, we prove the second statement only, the proof 
of the first one being similar. This statement, in turn, follows from the following theorem 
4.1. 

Theorem 4.1. Let p be in {1, ...,n—l}. Assume that, for every x^gM, there exist a 
curve t \~^ z{t) of class C^ {I; JVi), and a map (t,x) \-^ ip{t,x) = {ipi(t,x), ...,(pnit,x))Ell"' of 
class C^ defined in some neighborhood Ed xjyl of the curve {(t, z(t))G/xM | tG/} such 
that: 

1) for each fixed t&I, the map x ^— *> {fi{t, x), ..., ifn{t, x)) defines canonical coordinates 
for system (0j in the corresponding neighborhood Et := {x E IVi \ {t,x) G E} of z{t)E'M. 

2) z(-), and </?(■,■) satisfy the equalities 

^^^^'^'^%it) = ^^^^^^aizm ^ = l,...,p-l, tel; 



dx dx 

dipi(t,z{t)) 



,n, tel] (13) 



dt 
(For p=l, lil'^) has the form "^ J^^ =0, i = 1, . . . ,n, t E I, by definition) 

3) z{ti) = X*, z(T)=x^, and ^{t,,x*)z{t,) = ^{t,,x*)a{x*). 

Then, for every x'^ G M, there exist a curve t ^-^ y{t) of class C^(/, M), and a 
map (t,x) t— > ■?/'(t, a;) = ('?/'i(t,a;), ..., ^„(t, a;))GR" of class C^ defined in some neighborhood 
GcIxM of the curve {{t,y{t))eIxM \ tel} such that 

4) For each fixed tEl, the map x\-^{ipi(t,x), ...,ipn{t,x)) defines canonical coordinates 
for system ^ in the neighborhood Gt '■= {x E M \ (t,x) G G} of y(t) G M. 

5) y{-) and V'(-, ■) satisfy the equalities 

dipiit.yit)) dipi{t,y{t)) 

T^ y{t) = ^ a{y{t)), 2 = 1, ...,p, tel; 

ox ox 

'I^tlM^^O, ,: = 1,...,„, ie/; (14) 

6) v(ti)=x', y{T)^x^, and ^gl{t„x-)y{h) = ^(tux-)a(x') 

Let us show that theorem 4.1 implies theorem 3.1. Indeed, for p = 1, the construc- 
tion of z{-), and f{-,-) such that conditions 1),2),3) of theorem 4.1 hold is straightfor- 
ward. Let (=ip{x) {Q=ipi{x), i = l,...,n) be any canonical coordinates for system (jHl) in 
a neighborhood of x*, and let (0) be the dynamics of Q in the coordinates (Ci,...,Cn)- 
Given an arbitrary x^ElVi, pick any 2;(-)gC^(/; M) such that z(ti) = x*, z{T) = x^. Since 
the definition of the Lie derivative does not depend on local coordinates, the condition 
-^{ti,x*)z{ti) = -^{ti,x*)a{x*) is equivalent to the equality Ci(^i) = /i(Cr)C2) (where 
((t) = ip{z(t)), (i{t) := (pi{z{t)), Q = (pi{x*), i = l,...,n), and does not depend on the 
choice of canonical coordinates around x*. Therefore, we can easily choose z{-) G G^{I; M) 



such that the condition -^{ti,x*)z{ti) = -^{ti,x*)a{x*) holds along with the equalities 
z{ti)=x*, z{T)=x'^ from the very beginning. Then z{-) satisfies condition 3) with p=l 
for every function {t,x) h-> ip{t,x) G R" defined in a neighborhood of {{t,z{t)) \ tEl}, 
and satisfying conditions 1),2) of theorem 4.1. In order to construct ^pi-,-), consider 
vector fields t>i(-), ..., f„(-) on M such that Ai{x) = span{t>„_j(x), f„_j+i(a;), ..., f„(x)} 
for all a;GM, i=0, ...,n—l. (Since M is simply connected, it is orientable as well as 
Aj(-), i = 0,...,n— 1, and such vector fields do exist). Then, for each ^gM, the map 
(ti,...,t„) 1-^ (^^"^ o ^Jj*^-! o ... o $Jji) (^) is a diffeomorphism of some (small) neighbor- 
hoods B^(0) and U{^) of OgR" and ^gM respectively. Let x ^^ 0(^, x) (tj = (f)i{^,x), 
i=l, ...,n) be the inverse diffeomorphism of U{C,) onto S^(0). For any fixed (t'J, ■■■,t^), the 
map (tj+i, ..., t„) 1-^ f •l)*'^ o $*^-\ o ... o $t^+\ o <|)*^ o ... o <|)*\ j (^) defines the integral mani- 
fold of the distribution A„_j_i(-) in f/(^), i=l, ..., n—1. Therefore, for every fixed ^gM, the 
map X H-> (p{C,,x) (ti = (j)i{^,x), i=l,...,n) defines canonical coordinates (ti,...,t„) for sys- 
tem in some neighborhood f/(0 of ^- Taking into account that 0(^, C,) = for all xgM, 
we obtain that the map x ^—>- ip{t, x) defined by ip{t, x)=(f){z{t),x) in some neighborhood of 
{{t,z(t)) I tG/} and the curve z{-) G C^(/;M) satisfy conditions 1), 2), 3) of theorem 4.1 
with p=l. 

Then, using theorem 4.1, and induction over p = 1,2,..., n—1, we get the existence of 
a curve y(-)GC^(/; M) and a map x\^ip(t,x) = {ipi{t,x), ...,ilJn(t,x)) G R" of class C^ in a 
neighborhood G C / x M of {(t, y(t)) \ tEl} such that conditions 4), 5), 6) of theorem 4.1 
hold with p=n—l, which implies, in particular that y(ti)=x*, y{T)=x^, and 

dx y^>^ di ^yyy^))^ 2 = l,...,n-l, tG/; (15) 

Since (^"1(^5 ■)' ■■■y^'nit, ■)) ^^^ canonical coordinates in some neighborhood of y{t) for each 
tG/, we obtain from condition (A): 

dMt,y{t))^^ 



dx 

dMt,y{t)) 

dx 
Therefore, (fT3j) implies that 



%(t)) = 0, z = l,...,n-l, 

b{y{t)) ^ 0, for all tel (16) 



dipi{t,y{t)) dipi{t,y{t)) 

S ^W = 7^ Hy{t)) + P{y{t),u{t))b{y{t))) , t G / 

ax ax 

i = l,...,n—l, for each m(-) G /voo(/; R^) 

Then using a modification of the well-known Filippov lemma, condition (A), and (fTHIl (a 
similar argument can be found in jIZ|), we get the existence of m(-)gLoo(/; R^) such that 

dx ^^' ^ dx (^(^W)+/^(?/W'^W)^(2/W))' ^- 6- o^ ^' 

which yields 



Since the Jakoby matrix q^ is invertible for every tEl, the last equahty is equivalent 
to 

y{t)=a{y{t)) + P{y{t),u{t))b{y{t)), a. e. on I. 

Therefore, u{-) steers x* into x'^ in time I = [ti,T] w.r.t Q. The proof of the fact that x° 
can be steered into x* in time J = [to, ti] is similar. Thus our main goal is to prove theorem 
4.1. 



5. Proof of theorem 4.1. 

Next we always treat M as R"', and always write R" instead of M just to simplify 
the notation, and to make the arguments clearer. For every e > 0, every C^R^^ ^ind every 
xgR", we denote by B^{(), and ^^(x) the open balls in R^ and in R" respectively given 
by -Be(C) '■= {C^R^ I IC~CI < ^}; ^eix) := {ireR"' | \x—x\ < e}, where | ■ | is the standard 
norm generated by the standard scalar products of R^ and R" respectively. 

Take an arbitrary pGJl, ...,n— 1}, and an arbitrary x^gR". Assume that a curve 
-2(-)gC"'^(/; R"), and a map {t,x) h-> {p(t,x) = {Lpi(t,x), ...,ipn(t,x)) G R", which is of class 
C^ in some neighborhood EcIx'R,"' of the set {(t, 2;(t))G/xR" | tG/}, satisfy conditions 
1),2),3) of theorem 4.1. Let C=(f){x) {(i=(j)i{x), i=l,...,n) be some fixed canonical coor- 
dinates for system in some small neighborhood U{x*)gW{x*) of x*, where W{x*) is 
defined in (IT^ (for instance, we may put (l){x) := ip(ti,x) - see conditions 1), 3) of the- 
orem 4.1), and let © be the dynamics of Q in the local coordinates (Ci,...,Cn) (iii the 
neighborhood U{x*). Choose a > (a < T-ti) such that z{t)eU{x*) for all t G [ti,ti+a], 
and put by definition D := (j){U{x*)); (* := 4>{x*); Q := (pii^x*), i=l, ...,n; C*{t) '■= (Pi^i't)), 
C*(t) := M^it)), i=l,...,n, for all t G [ti,ti+a]. 

Without loss of generality, we assume that 

^={(Ci,-,Cn)eR"| \Ck\<crk, k = l,...,n} 

with some crfc>0, k=l,...,n, and that every integral manifold of each Aj(-) {i=0, ...,n—2) 
in D = (f){U{x*)) is equal to 

{(Ci,...,Cn)GR" I Cfc=Cfc, A; = l,...,n-2-l; ICfel < CTfc, k=n-i,...,n} 

with some Ca?; k=l, ...,n—i—l such that \(^\ < au- 

By the construction (see conditions 2), and 3) of theorem 4.1), we have 

C;W = /^(CrW,---,CmW), ^ = 1,...,P-1; tG[ti,ti+a] 

c(ti) = c, ^ = i,...,n; c;(ti) = /p(cr,...,c;,c;+i). 

In addition, 

-(c,...,c;,c;+i)7^o 



dU 



dCp+i 

- see flT^ . Therefore, there exist a G]0,a[ and w{-) G C([ti, ti+o"]; R^) such that w{ti] 
Cp+i, and 

\w{t)\<ap+,, i.e., (Ci*(t),...,c;(t),t/7(t),c;+2W,-,cw)eD 
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for all t e [ti,ti+a] (17) 

and 

c;w = fp{CAt),...,c;{t),w{t)), t e [h,t,+a] (18) 

For any (p-^-i{-)EC{[ti,ti + cr];R-'^) such that 

|Cp+i(t)|<(Tp+i, i.e., {(Ci,...,Cp,Cp+iW,C;+2W,-,C(t))l CeR\ ^=i,...,p}nD^0 

for all t G [ti,ti+o"], we denote by t i-^ vi't/Cp+ii')) the (maximal) trajectory of the p - 
dimensional control system 

Ut) = MCi{t),...,Ci+i{t)), t = l,...,p; te[ti,h+a] (19) 

(with states (Ci;---;Cp)) with the control Cp+i(")=Cp+i(')) ^^^ with the initial condition 
Ci{h)=Q,i=l,...,p. 

Since |^p— -It^O, i=l,...,n in D (see (I12j) ). the linearization of (J19p around 
(Cr(-),-,C;(-)r^i(-)) given by 






W = E^(CiW'-'CmW)x.(i), ^ = 1,-,P; tG[ti,ti+a] (20) 

with states (xi, •••, Xp)^^^ ^^^ controls Xp+i^R-^ is completely controllable; therefore there 
exist p controls Wi(-) G C^{[ti,ti+a];lV-), i = l,...,p such that 

(Ci) Wi{ti) = Wi{ti) = Wi{ti+a) = Wi{ti+a) = 0, i = 1, ...,p; 

(C2) Each control w,{-) steers OgR^ into e, = (0, ...,0, 1, 0, ...,0)gRp (the i-th unit 
vector of the standard basis in R^) in time / w.r.t. (J2U|) . 

p 
For every A = (Ai, ..., Ap)GRP, we define w\{-) as follows wx{t) := w{t) + ^ XjWj{t), 

i=i 
t G [ti,ti+a]. Then, «;a(-)|a=o = w{-y, r]{t,w{-)) = (Ci*(t), ...,C;(t)), for all tG[ti, ti+cr], and, 

therefore, the trajectory ti^r]{t, w\{-)) is well-defined on [ti, ti+a] for all A from some small 

neighborhood of OgR^; {7]{t,wxi-)),wxit)Xp+2it), ■ ■ • ,C(^)) ^ D for all tG[ti, ti+d], and all 

A in this neighborhood of OgR^; and the map A i— > -F(A) given by F{X) := ri(ti+a,wx{-)) 

is well-defined in this neighborhood of A=OgR^. 

Furthermore, from (C2), we get |f(0) = (0, ..., 0, 1, 0, ...., 0)^ G R^ (the i-th unit 

vector of the standard canonical basis in R^); therefore, there is e > such that the 

map A ^-^ F{X) is a well-defined diffeomorphism of -^^(O) onto some open neighborhood of 

ri(ti+(r,w{-)) = (Ci(ti+cr), . . . ,Cp(ii+o"))- Then there exists ei > such that 



B,Mti+cT,w{-))) C F{BM) and n,,{C{t,+a)) C D. 

Without loss of generality, we may assume that e>0, and £:i>0 are small enough and satisfy 
the condition: 

|aCp+i(^) + (1 - Oi)wxit) + ^p+i| < (Tp+i, whenever |A|<£, 0<a;<l, 
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|ep+i|<£i, te[ti,ti+a] (21) 

Fix any £2 > such that 

nJAt)) C Et for all t E I, (22) 

where Et was defined in condition 1) of theorem 4.1, and 



<p{n,Mti+'T))) c n^^iCih+cr)) (23) 

Lemma 5.1. There are a curve y{-) G C"'^([ti+cr, T], R"), and a map (t,x) h-^ 
^(t, x) = (^i(t, x), ...,-?/'„ (t, x))eR'^ of class C^ defined in some neighborhood Gc[ti+a,T] x 
R" of the curve {(t, x)G[ti+o-,T]xR" | x = y{t), te[ti+a,T]} such that 

1) For each fixed tE[ti+a,T], the map x\-^{ipi{t,x), ....tpnit.x)) defines canonical coor- 
dinates for system (0j in the neighborhood Gt '■= {x G R" | (t,x) G G} of y{t). 

2) y{-) and V'(-, ■) satisfy the equalities 

di ^^'^ di "(^W)' ^ = 1>->P> tG[ti+a,T]; 

dipiit.yit)) 



dt 



0, "^ = 1, ■■■,n, t G [ti+cr, T]; 



3) y{T) = x^, and y{ti+a) G ^eii^iti + a)). 

The proof of lemma 5.1 is given below in section 6. (Of course, it is based on condition 
(B), and on definition 3.1). 

Let us assume that lemma 5.1 is already proved. This allows us to complete the proof 
of theorem 4.1 as follows. Put 

C(t) := <P{y{t)), Q{t) ■= Uvit)), ^ = 1, ..., n, t G [t^+a, ti+a], (24) 

where aGJa, ct] is such that y(t) G U{x*), whenever tE[ti+a,ti+a]. Then, we obtain from 
()23|1 and from condition 3) of lemma 5.1 

C(ti + cr)Gfi^(C(ti+a)). (25) 

Using ()21|) . and the standard argument based on the Gronwall-Bellmann lemma, and on 
the Brouwer fixed point theorem - see [21] (and ^Hl , [20] for our case) we get the existence 
of a control w{-) of class C"^([ti, ti+a]; R^), (|w(t)| < cTp+i, tG[ti, ti+cr], whereas the norm 
II w{-) — 'w{-)\\i_^/u^ ti+o-iRi) should be small enough) such that 

(C3) t&(ti)=c;+i, f (ii)=/p+i(cr,-,c,c+i,c;+2) w{t,+a)=cMii+^), f (^i+^) = 

%i(t,+a). 

p 

(C4) The map A 1— > F{X) := ri{ti+a,w{-)+ J2 ^j'^ji')) is well-defined for all A G i?e(0), 

i=i 

and BEx{v{ti+a,w{-))) C F{B,{0)). 

Then we obtain from condition (C4) and from (f^3|) (see PnJ5[2D]) that there exists 
A* = {Xl,...,X*p) in 5^(0) such that {Ci{ti+a), ...,Cp{ti+a))=r]{ti+a,wx*{-)), where wx*{-) 
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P _ 

is given by w\*{t):=w{t)+ ^ X*Wj{t), t G [ti,ti+cr]. Let us define y{t), and ^(t) := (j){y{t)) 

on [ti,ti+cr] as follows: by definition, put 

(Ci(t),...,CpW) ■.= v{t,wx4-)), Cp+iW ■■=wx4t), te[h,h+a]; (26) 

in addition, let Cp+2i')j ■■■yCni') be any functions of class C^{[ti,ti + a]; IV-) such that 

Ciiti+a) = Uh+cr), ^iti+^) = ^(^1+^)' ^ = P+2,...,n, (27) 

C,(ti) = C, ^ = P+2,...,n, (28) 

and such that 

|Ci(t)|<a,, z=p+2,...,n, i. e., (Ci(t),...,C„(t))G/^ for alH G [ti, ti+a], (29) 

and then put: 

at) ■■= (Ci(t),...,C„W), yit) ■■= r\m), for an t e [h,h+a[ (30) 

Thus, we have constructed y{-) of class C^(/; R^) such that conditions 4), 5), 6) of theorem 
4.1 hold with every canonical coordinate functions ■ipj{t,y), j = 1, ..., n. Indeed, the inclusion 
y{-) G C^{I; R") follows from (J21D, from dSUD, and from (j27D>(EnD (in addition, we take into 
account that 

by (Ci), (C3), and by ©, and that 



^(ti + (t) = /.(Ci(ti + cr), ..., 6+i(ti + a)) = /,(Ci(ti + a), ..., C.+i(ti + a)) = 

= — ^(ti + a), i = l,...,p 

by the construction). Conditions 4), and 5) of theorem 4.1 follow from conditions 1), and 
2) of lemma 5.1 respectively (by the construction, (fT^ is true for all t G [ti,ti+cr], and 
we can easily construct the appropriate ip{t,x) for all t G / following the argument from 
section 4). The equality y{T) = x^ follows from condition 3) of lemma 5.1; the equality 
y{ti) = X* follows from the definition of ({■) : indeed, by the definition of ri{t, f (■)), we have 

iUti),-Xpi^i)) = vituwA-)) = (cr,-,c;); 

conditions (C3), and (Ci) yield Cp+i(^i) = u]x*(ti) = Cp+i! taking into account (J2H1), we 
obtain ({ti) = (Ci*, ...,C) = C*, which implies that y{ti) = 0~i(C(ti)) = (j)^^iC) = x*. 
Finally, we obtain from (C3), and from (Ci) 

7, (^1) = /p+l(Cl) •••) Cp; Cp+1) Cp+2)^ 

which yields: g^^ [ti, x*)y{ti) = ^^^ (ti, x*)a{x*) (because the definition of the Lie deriva- 
tive does not depend on coordinates). Therefore, ?/(■), and '?/'(■,■) satisfy condition 6) of 
theorem 4.1 as well. The proof of theorem 4.1 is complete. 
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6. Proof of lemma 5.1. 



Consider the following control system of ordinary differential equations 



%^(t,x(t)) + ^(t,a:(t))i(t) = ^(t); 



g^-{t,x{t))x{t) = ^{t,x{t))a{x{t)), 



'-§tit,x{t)) + '-^{t,x{t))x{t) 



0, 



j=l,...,p-l, teJ, (t,x) eE; 

tel, {t,x) eE (31) 

j=p+l,...,ra, t e I, {t,x) G E; 



(If p = 1, then the first row is empty by definition) with states xgR", (t, x)^E, and controls 
i)GR^. Since the Jakoby matrix ^{t,x) is invertible for all {t,x)EE (see condition 1) of 
theorem 4.1), we can rewrite (p?T|l in its standard form 

x{t) = F{t, x{t),v{t)), t G /, (t, x) G E, 

where F(-, ■, ■) is given by 



(32) 



r{t,x,v) = [ 



dip(t,x) 
dx 



I ^it,x)aix) \ 

%i(t,x)a(x 

at 
at v'''-^ 



v-'-^it,x) 



(33) 



Given (r, x) G E and f (■)G-Loo(/; R^), denote by t^— s>x(t, r, x, f (■)) the maximal trajec- 
tory of system (J3T|) with the control f (■) and with the initial condition x(r, r, £, f (■)) = x (of 
course, (t,a;(t, r, x, f (■))) G E for all admissible t). In addition, if t> = t>(t,x) is a feedback 
control, which can be time-varying, and even discontinuous, defined in some open subset 
E G E, in general, and if (r, x) G E, then we denote hj t \—>- x{t, r, x, v{-, ■)) the (maximal) 
trajectory of (J3T|l such that x(r, r, x,f (■, ■)) = a; as well (if this trajectory is well-defined). 
From conditions 2) and 3) of theorem 4.1, it follows that 



z{t) = x{t, T, x^, fo(-)) for ^11 t G /, 



with 



voit) := 0, 



t G /, 



(34) 



(35) 



and then, using the Gronwall-Bellmann lemma, we get the existence of 5 > such that the 
trajectory 1 1— > x{t, T, x'^, f (■)) of system (jH^ is well-defined for all tG/, and 



£2 



{t,x{t,T,x,v{-))) e E and \x{t,T,x,v{-)) ~ z{t)\ < ^ 



for all tG/, whenever || t>(-) — 'i^o(')llL^(/Ri) 

for every v{-) G Lao{I; R^) where £2 > was defined in (J2S1)- 
By definition, put: 



<,5 



(36) 



T:={(t,x) G/xR" I tG/; |x-z(t)| < £2}- 



(37) 
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Lemma 6.1. There exist a curve x{-)^C{T, R"), a finite sequence of open sets {'Ji}^^^ 
of the form7i =\Ti—ai,Ti+ai[xVLp-[xi) with some {Ti,Xi) e7, i = 1,...,N, a finite sequence 
of numbers t* in [ti, T], i = 1, . . . , A^+1, A^ finite sequences of vector fields z/j={z/f (■)}^'^-^ 
each of which belongs to A„_p_i(-) (i.e. z/f (■)GA„_p_i(-), k=l,...,ki, i=l, ...,N), and N 
finite sequences of numbers /ii={/if}fcLi, /wf>0, k=l,...,ki, i=l,...,N, such that 

N 



i;fift(x,)c2),i, k = l,...,ki; [J7iCE, t=l,...,N 

2) Tl=T>T2>...>Tl,>Tl,^^=ti] x(T)=x^; and {t,x{t)) e7i, whenever te[T*^i,T*], 

3) For every i=l, ..., A^, and every t G]r*^i, t*[, x(t) is well-defined, and 

^(t,x(t))x(t) = ^(t,x(t))a(x(t)), j=l,...,p-l, tG]r*,i,r;[, z=l,...,iV, (38) 

^{t,x{t)) + ^{t,x{t))x{t)=v,{t,x{t)), tG]r*,l,7^*[, 2=1,..., AT, (39) 

^(t,x(t)) + ^(t,x(t))i;(t) = 0, j=p+l,...,n, te]r:_^,,T*l i = l,...,N, (40) 

where Vi(t,x), i = 1, ..., A^ are given by 

t;,(t,x) = ^(t,x) + ^(t,x)(<l>:;;)^a($;f(x)) for all (t,x)eT„ z=l,...,N (41) 

and satisfy the conditions 

\vi{t,x)\<5 for each {t,x)e7i, i=l,...,N (42) 

with S defined in ^^) . 

(According to the definition of tlie diffeomorpfiisms $(^'(-) and $^^*(-) for fi- 
nite sequences '^j={^'f (■)}fc=i' f^i={f^i}k=i whicli was given in section 2, we have: 

First we assume that lemma 6.1 is aheady proved, and prove lemma 5.1. The proof 
of lemma 6.1, in turn, is based on condition (B) for system Q and is given in Appendix 
(we point out that it is a modification of the proofs of lemmas 3.4, and 3.1.1 from [20j; in 
particular, condition (B) allows us to find fj(t, x) given by (jUj), and satisfying (fl^ ). Let 
x(-) be a curve from lemma 6.1. To make the proof of lemma 5.1 clearer, we assume that 
ki = 1, i = 1,...,N, i.e. each sequence fii = {fJ'i}f,'^i and z/j = {^'f(-)}fcLi consists of one 
element only, and then, to simplify the notation, we put /Xj := ^}, z/j(-) := i^/(-) (however, 
we will explain how we can adjust our construction in the general case) 

Put v{t) := Vi(t,x{t)), tE]T*_^i,T*], i = 1,...,N. Then, f(-) is a piecewise continuous 
open-loop control. Combining (jl^ . and (|H^. and taking into account (|HH|) - Pm) . and con- 
dition 2) of lemma 6.1, we get 

\x{t) - z{t)\ < ^ foralHe/ (43) 
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Let A^o in {Ij---?-^} be such that T^^_^_^<ti+a<T^^. Without loss of generahty, we 
assume that T7VQ+i=ti+o"; otherwise, with shght abuse of notation, we put by definition 
T^g+i'-=ti+o', whereas t*, i=l,...,NQ are the same (the terminal point of the curve y{-) 
mentioned in lemma 5.1 is ti+a, and, therefore, we should deal with [ti+a, T] instead of 
[ti,T] in this section). 

Take any £3 > such that £3 < y. For any r<t in [ti+a, T], we put by definition: 

Tl = {is,z)e[r,t]xR-\ se[r,t]; |z - x(t)| < £3}; ^ ■-= ^l+. (44) 

By the construction, {t*_^i, x{r*_^-i^)) G Tj fl Tj+i, i=l, ..., A^o~l; therefore £3 in ]0, ^l can be 
chosen such that F in P^ satisfies the conditions 



F:;,cTi; r!^^cO-,nT,+i, ^ = l,...,iVo-l; F>+^ C T^„; (45) 

1 ^j+l JVn + l 



No 



rcljT,. (46) 



i=l 



Put a := min{ ' 2'^^ ' l^'^^^o}- Then, there exists M>0 such that, for ev- 
ery sequence >i={cri}iJ^i satisfying the conditions 0<crj<cr°, z=l, ..., A^o+l, there are a 
smooth time-varying vector field z/j^(t, ■), tG[ti+o", T], and a smooth function /i^(-) G 
C^{[ti+a;T]] [0,+cx)[) such that 

/i^(T)=/i^(ti+o-)=0; and /i^(t) = fii, 

whenever t G [T*_^i+<yt+i, r*-ai], i = 1,. ..,No; (47) 

z/^(t, ■) G A„_p_i(-), whenever t G [ti+a, T]; (48) 

u^(t,x) = Ui{x), whenever xeT>^^, t G [i^*^_^+(Tj+i, r^-di], i = l,...,A^o, (49) 

and such that the feedback control v^^it, x) given by 

..(t,x) = ^(t,x) + ^(t,x) ($::;;?)^a($::(f (x)) (5o) 

satisfies the condition 



max{\r{t,x,v^{t,x))\ \ te[ti+a;T]; xen,^{x{t))} < M, (51) 

where M is given by 

M ■=max{\r{t,x,v)\ \ v = ^{t,x) + 

+ ^{t,x){<l>>:,Xa{<l>-^^{x)), it,x)e% 0</i</ii; t=l,...,No}. (52) 

For instance, given >i={cri}i^i with small enough crjG]0,cr°[, take any functions Aj(-) G 
(:7°°([ti+or,T];R), z = l,...,A^o, and A(-) G C°°([ti+a, T]; R) such that 

^Ai(t) = l, and Ai(t) > 0, i = l,...,No, for all t G [ti+cT,T]; 
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A,(t) = l, whenever tG[Y^;i + ^, r;-^], z = 2, . . . , iVo - 1; Ai(t) = 1, 
whenever t E [t2+^, t*]; AAr(,(t) = 1 whenever t E [rj^o+i' ^ivo ^]; 



Aj(t) + Xi+i(t) = 1, whenever t E [t*_^i ^, t*_^^^^ — ^], i = 1, . . . , Nq-I; 



o"t+i * o"»+i- 

2 ' ^^+1 2 
No 

A(t) = 1 whenever t G [Jhf+i+o-j+i, T*-ai]; 

i=l 

< A(t) < 1 whenever t E [ti+a, T]; 

Afo-l 

A(t) = whenever tG |J [r*+i ^, ^m+^]; 

A(T) = A(ti+(T) = 0. 

No No 

Then /i^(-) and z/^(-, ■) given by iJ^{t)=Y, l^i^i{t)Ki)^ and i/^(t,x)= X) -^iW«^i(a^), 

tE[ti+a,T], X E V^^ satisfy (P7|)-(j^. 

Let us remark that our vector field z/^(t) is actually time-varying only around the 
moments of switching r*, which allows us to construct the smooth feedback control (jHOl)- If 
each Ui were a sequence of vector fields {z/f (■)}^*^-,^, we would have to take into account each 
switching from z/f(-) to z/^ "*" (■). The above-mentioned convex combinations would become 
more complicated, but the idea would be the same. 

To simplify the notation, put z/^(t) := z/^(t, ■). 

Lemma 6.2 There exists x={o'i}j^J!i with small enough ai, 0<crj<cr°, 2=1, ..., A^o+1 
such that the corresponding trajectory t i— > x^{t) := x(t,T,x'^ ,v^{-,-)) of system / T^) with 
the (smooth) feedback control v^{-, ■) given by i5U\} and with the "initial" condition x^{T) = 
x^ is well-defined for all t E [ti+a, T], and satisfies the condition 

\x^{t) - x{t)\ < £3 for all t E [ti+a,T] (53) 

(which implies {t,x^{t))) E T, whenever t E [ti+a,T]). 
To prove lemma 6.2, we just note that 

x^{t)=x{t,T,x'^ ,v^{-,-)) and x(t)=x(t, T, x^,f (■, ■)), for all tE[ti+(J,T] 

No 

and v^(t,x) = v(t,x), whenever tE |J [T*_^_-^+ai+i, T*—ai], x E Qeai^it)), where 

i=l 

v{t,x) := Vi{t,x), whenever T*_^_i<t<T*, {t,x)E7i, i = l,...,No, (54) 

with Vi{t,x) defined in ()41|) . In addition. 



max{\Fit,x,v^{t,x))\ \ tE[ti+a,T], x E n,.^{x{t))} < M; 



max{\F{t,x,v{t,x))\ \ tE[ti+a,T], x E ns^{x{t))} < M; 

Therefore, if (Xj > are small enough, then t\-^x^{t) is well-defined on [ti+a,T], and 
II Xj^{-) —x{-)\\(j^j.-^n) is small enough, which can be proved by the standard argument based 
on the Gronwall-Bellmann lemma. The proof of lemma 6.2 is complete. 
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Finally, we put: /i(t):=/i^(t), z/(t):=z/^(t), tG[ti+cr, T], with H^it), u^it) from lemma 
6.2, and 

y(t):=$;(^}*)(x^(t)), whenever te[h+a,T] (55) 

^,(t,y):=^,(t,<j;;(y)), J = l,...,p, whenever y e %i;,^\n,.,{x ^{t))) (56) 

Let us show that y{-) defined by ((SSI) satisfies conditions 1),2),3) of lemma 5.1. Indeed, 



taking into account that x^(t) = $^L(y(t)), we obtain from (j3^ . and from ()31|) : 



^v'.l^^^gd/W)) /^/^5*"^*^ 



?^ (^W)+kS) 2/W 



a(^,(t,<i>;:S(y(t))) .. 

By the construction, v{t) G A„_p_i, for all t; therefore 

for every admissible y and t. In addition, from (A),(B) it follows that 



« (<^:S(2/W)j - [KV))<y^')) e A„_,(<i.;:;;;(y(t))) 

Therefore, we get from (j37j) . (f^ 

a^,(t,$:g;(y(t))) . . c^^,(t,$:;;;(,(t))) . . , 

HZ (Kit)) y(^) = HI [Kit] «(?/W)' j=i,-,p-i, 



tG [ti+a,r]. 

Combining this with ((^. (jnU, (jSOI), (jSHl) we obtain that the last equality holds for j = p 
as well. On the other hand, by the definition of i(jj(t,y), the obtained equalities 

J = l, ...,p, t G [ti+cr,T] 

are equivalent to 

^'^Mt,y(t))y(t) = ^it,y{t))a{yit)), j = l,...,p. (59) 



dy dy 

Ti/^ri Tn(2il*Hci 111 I \ ft. 



Finally, by the construction, fi{T) = 0, which yields y{T) = $ /y\ (x^(T)) = x^(T) = x^. 



-/i(tl+CT), 



and /i(ti+a) = 0, which yields: yih+a) = ^^[^'^^"'{x^ih+a)) = x^(ti+a). 

Combining this with (jIHj) and (j^Hj) . we obtain: y(ti+a) G r2e2(2;(ti+cr)), which yields 
condition 3) of lemma 5.1. Let (t,x) t— > ip(t,x) = ('?/'i(t, x), ...,-?/'„ (t, x)) G R" be any map 
of class C^ defined in some neighborhood Gcfti+cr, T]xR" of the set {(t,x) G [ti+cr, T] x 
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R" I X = y(t), t G [ti+cr, T]} such that, for every fixed t & I, we have ip{t,y{t)) = 0, 
and the map x ^— i> (tpiitjx), . . . , ipnit , x)) defines canonical coordinates for system in the 
neighborhood Gt := {z G R" | {t,z)EG} of yit). (Since y{-) is aheady defined, we can 
easily pick such a map following the same pattern as that proposed in section 4 when 
proving theorem 3.1 as a corollary of theorem 4.1. For this, we should consider the map 
(ti, ..., t„) ^ ($L"„o$Lr-i°---°'^L\)(^W) for each fixed te[ti+a, T], where cUi(-), i=l, •.., n are 
any vector fields on R" such that Aj(x) = span{u;„_j(x), ciJ„_j+i(x), ..., c<j„(x)} for all xGR", 
2=0, ...,n—l. This map is a local diffeomorphism in some neighborhood of tj=0, i=l, ...,n, 
and the inverse map x i— ^ ip{t,x) defines canonical coordinates in a neighborhood of y{t) 
for every fixed t G [ti+cr, T], and satisfies the condition ip(t, y{t)) = G R", t G [ti+a, T]). 
Then, since the definition of the Lie derivative is coordinate-free, we obtain from ((SHI) 

dij,{t,y{t)) dij,{t,y{t)) 



yit)= g^ (^ivit)), J = l,...,p, tG[ti+a,T] 

0, j = l,...,n, te[h+a,T] 



dx dx 

dij,{t,y{t)) 



dt 
which yields conditions 1), and 2) of lemma 5.1. 

Thus ?/(■), and ip{-, ■)={ipi{-, ■), ...,ipn{-, ■)) satisfy conditions 1), 2), 3) of lemma 5.1. 
The proof of lemma 5.1 is complete. 



7. Appendix 

7.1. Proof of lemma 6.1. 

From conditions (A),(B) it follows that for each (t, x) in T = {{t, x) \ t&I, \x — z{t)\ < 
£2} (see dSZI)) there exist a smooth vector field i^t,x{-) £ ^n-p-ii'), and a point y = $ '^'''' 
with some fit,x^O such that 



l^t,x v-^J 



(Actually, there is a finite sequence i't,x of vector fields from A„_p_i(-) and the corresponding 
sequence, of nonnegative numbers, which we denote by iJit,x, satisfying the above-mentioned 
equality, as in the formulation of lemma 6.1. However, to make the arguments clearer, 
we again assume (without loss of generality) that each of these sequences consists on one 
element only, then we denote these elements by z/ja., and iit,x respectively. The proof for the 
general case is the same). Let 7t,x be an open set of the form 7t,x =\t—a, t+a[xr2^(x) with 
some a>0, /3>0 such that for its closure 7t,x = [t—a,t+a] x ^/^(x) we get $~'^^(f2^(a;)) C 
2)j,,^ for all /iG[0,/itJ, and 

\^{s,z) + ^is,z) (<|.:;-)^a($-^J-(;.))| <5 for all {s,z)e%., (60) 

where 6 is defined in (IS^ . Since Tc |J 7t^x, and T is a compact set, there exists a finite 

(t,a;)GT 

open subcovering {7r=7t^,xrVr'Li such that T C [J Tr. To simplify the notation, we put by 
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definition: 

Then 

|^(t,x) + ^{t,x) ($e:),a(<l>-'^^(x))| < 6 for all {t,x) G % (62) 

By definition, put: 

1 , ,^ r I / Ml dipJt,x) 

L := — -, where M := maxj |F(t,x,w)| \ v— ' 



2(M+1)' L I w w, , ^^ 

dipp{t,x) 



, ^^ ($;;j,a(<l>;^'^(x)), (t,x)GT,,, 0</i</i„ z=l,...,ro} (63) 

Given any (t,x) in |J T,,, define 9t^x{-) and Tt^2.(-) as follows 

r=l 

Ot,x{z) := t + a^^ — L\z — x\; Tt^x{z) := t — a^^ + L\z — x\ for all z G R", 
where a°^ > is a small positive number such that for each set 

St,x ■■= {{s,z) G / X R" I Tt,x{z) < s < 9t,x{z)} 
there is r=r(t, x)g{1, ...,^-0} such that St^x C 7r(t^x)- Since Tc IJ St^x, and T is compact, 

(t,x)GT 
mo 

there is a finite open covering {St^^xm}m=i of T : T C |J St^^xm- Again, in order to simplify 

m=l 

the notation, we put 

Omi-) = 6tra,xrai.-)'^ ^m := n™,x,„(-); ^m ■= {{s , z) G / X R" | Tmiz) < S < 6'„(z)}; 

7m-=%{m)', ^m{-) '■= ^r(tm,Xm){-)', /^m := /^r(i™,x'„) Zm ■= Xr{t^,Xm) (64) 

Thus, from now on, we deal with notation ()64|) . and notation (jM|) is no longer valid. Let 
us remark that each 9m{-) and each Xm(-) satisfy the global Lipschitz condition 

VyGR" V;2GR" \T,{y) - T,{z)\ < L \y - z\; |^,(y) - ^,(^)| < L ||/ - ^|, 3=1,..., mo. 

Let S be the system of all the sets given by 

^e(-)M-)Ae,A, ■■= {(s, ^) G R X R" I ^{z) < s < e{z)} \ {(s, ^) G R x R" | {s = 

= i9{z), z G A^) or (s = e{z), z G A©)} (65) 

where 0(-)? and '&{■) run through the set of all the functions of class C(R"; I) such that, 
for all (2/,z)gR"xR", 

\e{y)~&{z)\<L\y-z\ and \^{y)-^{z)\<L\y-z\, for all yGR", 2GR", (66) 

(with L defined in (jHSl)) and AeCR", A^cR", run through the set of all subsets of R". 
Note that, ii 'dj{-), j=l, ...,N, are some functions of R" to R such that 

VyGR"V^GR" \^,{y)-^,{z)\<L\y-z\, j = l,...,N, 
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then, we obtain: 



and 



Vy eW WzeW I max {^jiy)} - max {^jiz)}\ < L \y ~ z\, 

j=l,...,N j=l,...,Af 



VyGR" V^gR" I min {^j{y)} - min {^j{z)}\ < L \y - z\. 

j=l,...,N j=l,...,N 



Therefore, it is easy to prove that S satisfies the following conditions: (a) 0gS; (b) 
for each S'gS, and each S"gH, we have S'f]S" G S; and (c), for every SgS, and every 
SiGS, if SiCS, then there exists a finite sequence {S^j^^g C S of sets from S such that 

90 

S = IJ Eg, and Sjf^Sj = for all ij^j, {i,j}c{l, ..., go}- (In other words, S is a "semiring" 

9=1 

of sets - see [H]). Since every 5*^, m=l, ...,mo is an element of S, we get the existence of 
a finite sequence {S/}/^-^ of sets S/ = S0j(.)_^;(.)^^q ^^^ G S (see (jU3j) . (jUBjl ) such that first, 

T,i' f] Sp = for all /' ^ I" in {1, ..., Iq}; second, T C |J S/ = |J 5*^; and, third, for each I 

1=1 m=l 

in {1, ..., Iq} there is m{l) in {1, ..., mo} such that S^ C ^^.{i)- 

For each / G {1, ..., /o}, we define the feedback control vi{t, x) in 7m(i) as follows 

.Kt,x)=^^^+^^^ ($tc'o').«($;:o"^(^)) whenever (t,x) G 7.(o, (67) 

if) 
and then we define the following (discontinuous!) feedback control v = v{t, x) in S := [J S^ 

1=1 
for svstem (j^T|) 

v(t,x) ■.= vi{t,x) whenever (t, x) G S/, Z = l,...,/o- (68) 

Then, the following statement holds. 

Lemma 7.1 There are a unique trajectory x{-) G C(/; R") of system i31]} with the 
feedback law v = v(t,x) given by i68^} . and with the initial condition x{T) = a;^, a unique 
finite sequence of indices {lj}j^i C {!,... ,/o} o,nd a unique sequence T = r* > T2 > ... > 
^N > '^N+1 = ^1 '^''^c/i that li 7^ Ij for all i ^ j in {1, ..., A^} and 

1) x{-) is defined and continuous at each t in I \{t2, ....,t^} and 

(t,x(t))GT and \v{t,x{t))\ < 5 (69) 

for all t & I. 

2) For every j=l,...,N we obtain 

{t,x{t))e^i^; x{t) = F{t,x{t),v{t,x{t))) for all te]T*^-^,T*[ (70) 

r; = e,^,(^(r;)); r;^^ = ^,^,(^(r;+J); (71) 

where F is defined in \3'J\) . and 0«(-), "*?«(■) ^^^ given in the definition of Hi. 

Proof of lemma 7.1. We will prove the existence and the uniqueness of x(-) and 
the corresponding {T,^}.^^ by the induction over i=l,...,N. In addition, we will prove 
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(by induction on i=l, ..., A^) that the trajectory x(-) and the functions (t,x)\-^si(t,x), and 
(t,x)^^t^(t,x), given by 

si{t,x)=t-^i{x), ti{t,x)=t-Qi{x), (t,x)GRxR" (72) 

satisfy the conditions 

^^^^ > Slit, x{t)) - Si{t, x{r)) > ^; ^^^^ > ti{t, x{t)) - ti{r, x{r)) > 

>^ foralH>r, {t,T} C [t*,T], 1 = 1,. ..Jo- (73) 

For i = 1, we put by definition: r* = r^ = T. At this stage, we have empty set of Ij, 
S;,, and empty set of equahties (jTO)), (f7T|) . (f7H|) . j=l, ...,i— 1, and the algorithm for getting 
/i, S;^, and r2 is the same as in the general case i>l, which we consider now. 

Assume that, for some i > I, there are a unique sequence {/jljC^ (for i = I, the sequence 
is empty - see the previous paragraph) such that Ij ^ /^ for all j ^ g in {1, ..., -i— 1}, a unique 
sequence T=rj'>r2 >...>r*>ti, and a trajectory x(■)GC([7^*, T]; R") such that (jEHl), and (f7H|) 
hold for all t G [tj*,T]; and (f70|l . (f7T|l hold for all j=l, ...,i— 1; x(-) being well-defined and 
continuous on \rl ,T\ \ {t^, •••,t*} (again, for i = 1, we deal with empty set of equalities 
dZni), dZH), dZSl), and (jnni) becomes trivial). 

If T*=ti, the proof is complete, therefore we assume that T*>ti. By the induction 

hypothesis, (r*, x(r*)) G T; then, since T C int I |J Sh by the construction, we get the ex- 

h) 
istence of ao > such that {t*—s,x{t*))e |J S^ for all s G]0,a;o]. Since S;/ f] S^// = 

1=1 
for all I' 7^ /", there are a unique /jG{1, ..., /q} and a unique r G [ti,T,*[ such that 

]r,r;[x{a;(r*)} C S^^, and r = 7?,^(x(r;)), r/ = ei^(a;(7;*)). Since w«,(-,-) is well-defined in 
■^mC/,) (see dnil)), and (r;,a;(r;))GSi^ C 'J„(,^), the trajectory th->a;(t, ri*,a;(r;),t;/,(-, ■)) is well- 
defined on some maximal ]s, r/] such that x(t, r*,a;(r*),f;-(-, ■)) G 1m(/.) for all t g]s, r*[. 
To simplify the notation, we put xi.{t) := x{t, t*, x{t*), vi.{-, ■)) for t g]s, t*]. Let us remark 
that from (jH^ . ljU^ . (jUB|) (and from the inclusions E^gS, /=1, ..., /q) it follows that, for every 
/'g{1, ..., /o} such that {T*,x{T*))E7rn(i') the trajectory t h-> xi'{t) := x(t, r^*, x(rj*), fi/(-, ■)) 
satisfies the conditions 

^^^-^ > sKt,Xi,(t)) - SiiT,Xi,iT)) > (^ " ^^ 
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^^^~^^ >tKt,x,,(t))-tKr,a:p(r))>^^^, t > r, / = 1, ..., /q (74) 

In particular, (ffl|l holds for l'=li and for all t, t in ]s, t*[, which implies that t h-» si{t, x/,(t)), 
and t I— > ti(t,xiXt)) are strictly increasing on ]s, rj*[. From the induction hypothesis (see 
(ffT|l for j = 1, ...,i-l) it follows that ti{T*,x{T*)) = 0, s;(r*,x(r*)) > 0. Since si{t,x) > 0, 
and ti{t,x) < are equivalent to t > ^i{x) and t < Qi{x) respectively, we obtain that 
(t, x{t, T*, x{t*),Vi.{-, ■))) belongs to S^. for all tG]r*— ag, r*[ with some ao>0, and moreover 
there is a unique r*^_;^ g]s, r*[ such that ti-(t,xi-(t)) < 0, si-(t,xiXt)) > for all t &]t*_^i,t*[, 
and ti.{t,xi.(t)) < 0, si.(t,xi.(t)) < for all t g] s, rj*|_;^ [, which implies that 

(t,xJt))GS;^, xjt) = r(t,xjt),t;jt,x,^(t))) for all tG]r;Vi>^1 (75) 
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{t,xiM^^U for all te]s,T*^,[ (76) 

Taking into account that xj-(r*)=x(r*) by the construction, we obtain from (fTSj) and from 
the induction hypothesis that our /j, T,^, r*|_i, and x(t) given by x(t) := Xi^{t) for all 
t e h*+i,r*] satisfy §^-^, and ((721) for all j = 1, ...,i-l,2. 

The uniqueness of k, S/-, r*,_|, and x(-) on [r,*^_]^, r^*] such that (f75j) holds with 
some T*^i (''"i*+i <''!*) follows from (fri|) . which is true for each /' in {l,...,/o} such 
that {t*,x{t*)) e 7m{i')- Indeed, if there are I'^k in {l,...,/o}, ^*+i<t"o and x(-) G 
C([r*+„ r*]; R'^) fl C^'(]r*+i, ^1; R") such that 

a;(7^*)=x(7^*); x(t)eS, for all t e]rl„T*[ 

W{t) = rit,x{t),v{t,x{t))) = r{t,x{t),viit,x{t))), t G]r*+„r;[ 

^i'irli,xir:+i)) = r:+i, (77) 

then we get from ([71)) and from the definition of k : Si.{t,x{t)) > 0, tiXt,x{t)) < for 
t e]t, t*[ with some r G]r*_^;^, rj*[, which yields: {t,x{t)) G S^/ f] S/" for all t e]t, t*[. Since 
S;/ f] S/^ = for each /' ^ li, we obtain that /' = /j, which proves the uniqueness of /j and of 
S;.. This, in turn, implies that x{t) = x{t) for all t G [f, t*], where f := max{r*_,_-^, t*_^i}- The 
function S;-(t) = t — "diXt, ^if)) is strictly increasing on [r*_,_^, r^*] lj[''1+n ^lY therefore, from 
the equalities ^«,(r*+i,^(r*+i))=r*+i, ^u{tI^^,x{t*^^))=t*^^, it follows that f=T*^^=T*^^, 
which proves the uniqueness of r*j_^, and the uniqueness of x(-) on [r*,_i, t*]. Let us remark 
that (t,x(t)) G 7 for all t G [t*,_i,Tj*], which follows from the inclusion (t,x(t)) G T for 
t G [t*,T] (see the induction assumption) and from the choice of 5 (see (j^HJidSOl))- Finally, 
dZSl), and dZH) with /' = / yield 

^^^ ~ '^' > Slit, x{t)) - Si{T, x{t)) > ^^^; ^^^^ > ti{t, x{t)) - ti{T, x{r)) > 

>^^^ foralH>r, {t^r} C [t*^,,T], / = 1,...,/o, 

which implies that siXt,x(t))>0>sij(t,x(t)), j=l, ...,i—l, and therefore k ^ Ij for all 
j=l, ...,z— 1; hence /j ^ Ig for all g 7^ j, {g',j} C {l,...,z}. The construction of S/ , 
r*_^;^, and x{t), t G [t/+i,Tj*] is complete. 

Thus, we obtain by the induction sequences {/j}, {Sj}, r*, and the trajectory x(-) 
of system (|M|) with the feedback control v = v{t,x) given by (|UHj) such that x(T) = x^, 
r;_^i < r*; /, ^ /^ for all i ^ j, and ^-^ hold for all j = 1,2, . . . . If 7;*^i = ti 
for some i G N, we put A^ := i, and the proof of lemma 6.1 is complete. Otherwise, 
sequences {r*}, and {li} are infinite, which is impossible because {li} C {l,...,/o} and 
li 7^ Ij, whenever i 7^ j. The proof of lemma 7.1. is complete. Finally, we put Tj := 7m{ii), 
and fj(t, x) := Vi.{t, x), for all (t, x) &% := 7m{ii), i = 1, ...,N. Then we obtain from lemma 
7.1 that our sequences of Tj and Vi{-, ■) satisfy all the conditions of lemma 6.1. The proof 
of lemma 6.1. is complete. 
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